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Abstract 

In this paper we prove that in the high temperature region of the Sherrington- 
Kirkpatrick model for a typical realization of the disorder the weighted average of 
spins X]i<iv^«'^« '^ill be approximately Gaussian provided that maxj<jv l^il/ X]j<Af ^? is 
small. 
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1 Introduction. 

Consider a space of configurations S^v = { — 1,+!}^. A configuration a G S^r is a vector 
((Ti, . . . , (Tat) of spins ai each of which can take the values ±1. Consider an array {gij)i,j<N of 
i.i.d. standard normal random variables that is called the disorder. Given parameters (3 > 
and /i > 0, let us define a Hamiltonian on S 



N 



-Hn{(7) = -y= ^ gijCTiaj + h^ai, a = (ai, . . . , ctn) e T^n 

^ l<i<j<N i<N 
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and define a Gibbs' measure G on Sat by 



G{{a}) = exp{—Hiy{a))/ZN, where Zjy = exp(— i^Af (q-)). 

The normahzing factor Zn is called the partition function. Gibbs' measure G is a random 
measure on Ejy since it depends on the disorder (gij). The parameter /3 physically represents 
the inverse of the temperature and in this paper we will consider only the (very) high 
temperature region of the Sherrington-Kirkpatrick model which corresponds to 

/3<f3o (1.1) 

for some small absolute constant Po > 0. The actual value Pq is not specified here but, in 
principal, it can be determined through careful analysis of all arguments of this paper and 
references to other papers. 

For any n > 1 and a function / on the product space (S^,G®"), (/) will denote its 
expectation with respect to G®*^ 

{f) = J2f{a\...,anG^-i{ia\...,a-)}). 

The Sherrington-Kirkpatrick model has been studied extensively over the past thirty years 
(see, for example, [l]-[8], [11]-[18]). In this paper we will prove the following result concerning 
the high temperature region (jl.lj) . 

Given a vector (ti, . . . , ^at) such that 

tj + ... + t% = l (1.2) 

let us consider a random variable on (Sat, G) defined as 

X = tiai + . . . + tj^aN- (1-3) 

The main goal of this paper is to show that in the high temperature region (jl.ip the following 
holds. If maxj<Ar \ti\ is small then for a typical realization of the disorder (gij) the random 
variable X is approximately Gaussian r.v. with mean (X) and variance {X"^) — (X)"^. By the 
"typical realization" we understand that the statement holds on the set of measure close to 
1. 

This result is the analogue of a very classical result for independent random variables. 
Namely, given a sequence of independent random variables ■ ■ ■ ,C,n satisfying some inte- 
grability conditions the random variable + . . . + ^at will be approximately Gaussian if 
maxj<Ar Var(^j)/ ^.^^ Var(^j) is small (see, for example, ). In particular, if ai,...,aN 
in ()1.3|) were i.i.d. Bernoulli random variables then X would be approximately Gaussian 
provided that maXj<Ar \ti\ is small. 

It is important to note at this point that the main claim of this paper in some sense 
is a well expected result since it is well known that in the high temperature region the 
spins become "decoupled" in the limit N oo. For example. Theorem 2.4.10 in ^3] states 
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that for a fixed n > 1, for a typical reahzation of the disorder (gij) the distribution G®" 
becomes a product measure when N oo. Thus, in the very essence the claim that X in 
()1.3|1 is approximately Gaussian is a central limit theorem for weakly dependent random 
variables. However, the entire sequence (ai, . . . , a^) is a much more complicated object than 
a fixed finite subset (ai, . . . , an), and some unexpected complications arise that we will try 
to describe after we state our main result - Theorem ^ below. 

Instead of dealing with the random variable X we will look at its symmetrized version 
Y = X — X', where X' is an independent copy of X. If we can show that Y is approximately 
Gaussian then, obviously, X will also be approximately Gaussian. The main reason to con- 
sider a symmetrized version of X is very simple - it makes it much easier to keep track of 
numerous indices in all the arguments below, even though it would be possible to carry out 
similar arguments for a centered version X — {X). 

In order to show that for a typical realization (gij) and a small maxj<7v \ti\, Y is ap- 
proximately Gaussian with mean and variance (Y"^) we will proceed by showing that its 
moments behave like moments of a Gaussian random variable, i.e. 

(r') ^a(/)(r2)'/^ (1.4) 

where a(/) = Kg\ for a standard normal random variable g. Since the moments of the 
standard normal random variable are also characterized by the recursive formulas 

a(0) = 0, a(l) = 1 and a{l) = (/ - l)a{l - 2), 

f|1.4|) is equivalent to 

Let us define two sequences (cr^*^'^)z>o and (cr^*^'^)z>o of jointly independent random vari- 
ables with Gibbs' distribution G. We will assume that all indices and 2(/) are different 
and one can think of a^'-'-' and ^2(0 as different coordinates of the infinite product space 
(2^,6*®°°). Let us define a sequence Si by 

N 

S^ = J2ti(Tl where a' = a^^'^ - a^W. (1.5) 

In other words. Si are independent copies of Y. 

The following Theorem is the main result of the paper. 

Theorem 1 There exists /Sq > such that for (3 < (3q the following holds. For any natural 
numbers n > 1 and ki, . . . , kn > and k = ki + . . . + kn, we have 

n n 

\nT\{Sif^) -T\<hmSl?''\ = 0(max|t,|), (1.6) 

I J. J. J. J. I i<N 

1=1 1=1 

where 0(-) depends on Po,n, k but not on N. 
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Remark. Theorem ^answers the question raised in the Research problem 2.4.11 in |15j . 
Theorem easily implies that 

^{{U^Sir')-l[a{k){Sl)'/') =0(max|t,|). (1.7) 
1=1 1=1 *~ 

Indeed, 

1=1 1=1 

n n n n ^ 

1=1 1=1 1=1 1=1 

For the first and second terms on the right hand side we can use independent copies to 
represent the powers of (■)' and then apply Theorem ^ For example, 

n n 2n n 

1=1 1=1 l=n+l 1=1 

Similarly, 

n n 

E{]J{Si)'^){Sl)'/'={]Ja{ki))E{Sl)' + 0{m8.x\U\). 
1=1 1=1 

Clearly, combining these equations proves (|1.7|) . Now one can show that for ^ cx) and 
maxj<jv \ti\ — > the characteristic function of (5*1, . . . , Sn) can be approximated by the char- 
acteristic function of n independent Gaussian random variables with variance (5*^), for (gij) 
on the set of measure converging to 1. Given ()1.7|) this should be a mere exercise and we omit 
the details. This, of course, implies that (5*1, . . . , Sn) are approximately independent Gaus- 
sian random variables with respect to the measure G^°° and, in particular, 5*1 = Yli<N 
is approximately Gaussian with respect to the measure G®^. 

Theorem [2 looks very similar to the central limit theorem for the overlap 

1 ^ 

i=l 

where o"^,^^ are two independent copies of a (see, for example. Theorem 2.3.9 and Section 
2.7 in lin]). In fact, in our proofs we follow the main ideas and techniques of Sections 2.4 - 
2.7 in However, the proof of the central limit theorem for X in p.3|) turned out to be by 
at least an order of magnitude more technically involved than the proof of the central limit 
theorem for the overlap Ri^2 (at least we do not know any easier proof). One of the main 
reasons why the situation here gets more complicated is the absence of symmetry. Let us try 
to explain this informally. When dealing with the overlaps Rij one considers the quantity of 
the following type 

E([[i^;f) (1.8) 

i<j 
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and approximates it by the simpler quantities using a kind of Taylor's expansion. At the 
second order of approximation there appear the terms that have "smaller complexity" and 
a term that is the factor of ()1.8j) : one then can solve for ()1.8j) and proceed by induction on 
the "complexity". The main reason this trick works is the symmetry. It doesn't happen in 
the setting of Theorem ^ due to the lack of symmetry. Instead, we will have to consider both 
terms on the left hand side of ()1.6|) . 

n n 

EiHiSi)'') and l[a{k)E{Sl)'/', (1.9) 

1=1 1=1 

approximate both of them by a kind of Taylor's expansion up to the fourth order and carefully 
keep track of all the terms. Surprisingly, at the forth order of approximation some of the 
terms will not be small enough to yield the claim of Theorem ^ but the "large " terms 
corresponding to the two quantities ()1.9|) will cancel each other. 

Another difficulty that arises from the lack of symmetry is that unlike in the case of 
overlaps Rij we can not compute explicitly the expectation (X) and variance {X"^) — (X)^. 
Finally, we will need to develop the cavity method with two coordinates which, loosely speak- 
ing, makes two coordinates cxj, aj of a independent of all other coordinates. In the central 
limit theorem for the overlaps Rij the cavity method with one coordinate was sufficient. 



2 Preliminary results. 

We will first state several results from [15j that will be constantly used throughout the paper. 
Lemmas 1 through 6 below are either taken directly from or almost identical to some of 
the results ^3] and, therefore, we will state them without the proof. 
Let us consider 



^ ^ i<N~l 



where z is a standard normal r.v. independent of the disorder {gij) and q is the unique 
solution of the equation 

q = Eth^{pz^+h). (2.1) 
For < t < 1 let us consider the Hamiltonian 

-HN,t{(^) = -y= ^ gij(Tiaj + gt{(T) + h'^ai (2.2) 

and define Gibbs' measure Gt and expectation {■)t similarly to G and (■) above, only using 
the Hamiltonian —Hi^t{a). For any > 1 and a function / on let us define 

The case t = 1 corresponds to the Hamiltonian —HnIcx), and the case t = has a very 
special property that the last coordinate ctat is independent of the other coordinates which 
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is the main idea of the cavity method (see (Cavity method is a classical and fruitful 

idea in Physics ([Z|); but in this paper we refer to a specific version of the cavity method 
invented by Talagrand.) 

Given indices /, let us define 

1 ^ , _ 1 , 

= iv ^ ^"^^ " iV 5^ 

1=1 i=l 

The following Lemma holds. 

Lemma 1 For < t < 1, and for all functions f on we have 

l<l<V<n l<n 
+ /3^^^^^^.(/<Vr(^n+l,n+2-g)). (2.3) 

This is Proposition 2.4.5 in jTH]- 

□ 

Lemma 2 There exists /5o > and L > such that for (3 < (3q and for any k > 1, 

- < and .((i?i;, - qr) < [^)\ (2.4) 

This is Theorem 2.5.1 and Lemma 2.5.2 in [T3] . 

□ 

Roughly speaking, this two results explain the main idea behind the key methods of [T3] 
- the cavity method and the smart path method. The Hamiltonian (j2.2j) represents a "smart 
path" between the measures G and Gq, since along this path the derivative ^[{f) is small, 
because all terms in ()2.3p contain a factor Ri^i' — q which is small due to ()2.4j) . Measure Go 
has a special coordinate (cavity) aN that is independent of the other coordinates, which in 
many cases makes it easier to analyze z^o(/)- 

This two lemmas imply the following Taylor expansion for z/(/). 

Lemma 3 For a function f on we have 

Proof. Proof is almost identical to Proposition 2.5.3 in |15j . 

□ 

Cavity method with two coordinates. In this paper we will use another case of 
the cavity method with two coordinates ctat, cfn-i playing the special role. In this new case 
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we will consider a "smart path" that makes both coordinates aN and a^-i independent of 
other coordinates and of each other. This is done by slightly modifying the definition of 
the Hamiltonian ()2.2j) . Since it will always be clear from the context which "smart path" 
we are using, we will abuse the notations and use the same notations as in the case of the 
Hamiltonian ()2.2|1 . 
Let us consider 

^ i<N-2 ^ i<N-2 ^ 

+ /3Vl - t{ziy/qaN + Z2y/qcrN-i), 

where zi, Z2 are standard normal r.v. independent of the disorder [gij). 
For < t < 1 let us now consider the Hamiltonian 

-HN,tio-) = -j= ^ gijCTiaj + gticr) + h'^ai (2.6) 

^ l<i<j<N-2 i<N 

and define Gibbs' measure Gt and expectation {■)t similarly to G and (■) above, only using 
the Hamiltonian ()2.6I ) For any n > 1 and a function / on let us define 

We will make one distinction in the notations between the cases fj2.2|) and ()2.6|) . Namely, for 
t = in the case of the Hamiltonian ()2.6|) we will denote 

(/)oo=(/)t and uoo{f) = i^t{f) • (2.7) 



t=o 



t=0 



It is clear that with respect to the Gibbs' measure Go the last two coordinates and cn-i 
are independent of the other coordinates and of each other. 
Given indices /, /' let us define 



i<N-2 

The following lemma is the analogue of Lemma ^ for the case of the Hamiltonian ()2.6|) . 

Lemma 4 Consider z/((-) that corresponds to the Hamiltonian 112. f^) . Then, for < t < 1, 
and for all functions f on we have 



where 



v[U) = i+n+in (2.8) 



l<l<l'<n l<n 
+ P'^^^^Mf<'<'iR:+l,n+2-Q)\ (2.9) 



l<l<l'<n l<n 
+ /?'^^^^^t(/<-\<-'l(^:+l,n-,2-?)), (2.10) 



l<l<l'<n l<n 

1 2 ^{n + 1) . n+l n+2 n+l n+2 N IT ^ 

iV 2 ^^^J^N (^N ^N-l'^N-l)- ['^■^^) 

Proof. The proof repeats the proof of Proposition 2.4.5 in ^Hj almost without changes. 



Lemma 5 There exists (3o > and L > such that for (3 < (3q and for any k > 1, 

m{{RZ2-gr)<Li^{iRZ2-<ir) < {^Y- (2.12) 

The second inequahty is similar to ()2.4j) and it follows easily from it since |i?i^2~-Rr2l ^ 2/A^ 
(see, for example, the proof of Lemma 2.5.2 in ^Hl). The first inequality follows easily from 
Lemma m (see, for example. Proposition 2.4.6 in [TH]). 



Lemma El above also holds in the case of the Hamiltonian ()2.6|) . 
Lemma 6 For a function f on we have 

j=o ■'■ 

The proof is almost identical to the proof of Proposition 2.5.3 in [T3] . 

□ 

To prove Theorem ^ we will need several preliminary results. 

First, it will be very important to control the size of the random variables Si and we 
will start by proving exponential integrability of 5*^. 

Theorem 2 There exist (3q> Q and L > such that for all (3 < f3o, and for all k > 1 

N 

ly^iY^Ua^Y') <{Lk)'. (2.14) 



1=1 
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The statement of Theorem |21 is, obviously, equivalent to 

N 
i=l 

for large enough L. 

Proof. The proof mimics the proof of Theorem 2.5.1 in J3] (stated in Lemma |2 above). 

We will prove Theorem |21 by induction over k. Our induction assumption will be the 
following: there exist /?o > and L > such that for all /? < /5o, all > 1, all sequences 
(ti, . . . , In) such that J2iLi < I < k, we have 

N 

jy^iY^Ua.f) <iLiy. (2.15) 

1=1 

Let us start by proving this statement for k = 1. We have 

N N N 

^[{Y.^i(^^f) <4^t,' + ^t.tjZ/(ai(T,) <4+(^t,)V((Ti(T^) <4 + Nu{(Ti(Tn). 
1=1 1=1 i^j i=l 

Thus we need to prove that uiaiaN) < LN~^, for some absolute constant L > 0. ()2.5j) 
implies that 

We will now show that z/o(ctiCT7v) = and z/q((Ti(Tjv) = 0{N~^). The fact that i^o{(Tia]\r) = is 
obvious since for measure G®^ the last coordinates aj^, a% are independent of the first N —1 
coordinates and z/o((Ti(T7v) = i^o(f^i)^o(c"Ar ~ <^n) — 0- To prove that z/q((TiO"jv) = 0(A^^"'^) we 
use Lemma n which in this case implies that 

K{^i^n) = (3'^i'Q{aiaN(yN(rlf{Ri^2 - l)) - '2(3^Uo{aiaNcrlfCr%{Ri^3 - q)) 

- 2/3^0 (d-ia-iv(T^(7^(i?2^3 - q)) + 3p^Uo{aiaNcrf^crj^iR3^4 - Q)) 

= /5Vo(ai(a^ - a^)(i?i;2 - q)) - 2/3Vo(ai(a|/ - a^a^(T^)(i?^3 - q)) 

- 2f3^Uo{ai{a]^a%crlf - a%){R^;^ - g)) + 3f3'^Uo{ai{a]^ - cr%)a%a%{R^^^ - q)) 

Since for a fixed disorder (r.v. gij and z) the last coordinates < 4 are independent of 
the first — 1 coordinates and independent of each other, we can write 

i^q{^i^n) = f3^E(^{ai{R^^2 - q))o{(rj^ - (T^)o - 2(ai(i?^3 - g))o((x|^ - (T^a^a^)o 
-2(ai(i?2;3 - q))o{crWN(^N - (^n)o + ^^liRs^ - q))o{c^n " o^^)o(c^|/C^^)o) • 

First of all, the first and the last terms are equal to zero because (cr]^ — o"^)o = 0. Next, by 
symmetry 

{a.iRl, - g))o = {{al - aDiR^., - g))o = ((a? - al)iR,,, - g))o = -{oi^R'^^^ " 
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Therefore, we get 



2,, IT)- /'^3 ^1 Ji ^3 



-4/?Vo((Ti(i?i 3 -g))z/o((T 



It remains to show that vq{p\{R{.^ — q)) = 0{N^^). In order to avoid introducing new 
notations we notice that it is equivalent to proving that z/(cTi(i?i,3 — q)) = 0{N~^). Indeed, 
if we are able to prove that 

V/3 < /5o VA^ > 1 z/(ai(i?i,3 - q)) = 0{N'^) (2.16) 

then making a change of variables N^N — 1, f3^l3-= [3^/1 — 1/N < f3o, and q ^ q-, 
where g_ is the solution of ()2.1|) with (3 substituted with we would get 

Vo{ai{Rl^ - q-)) = 0{{N - 1)-') = 0{N-'). 

Lemma 2.4.15 in ^3] states that for (3 < (3q, \q — q-\ < LN~^ and, therefore, the above 
inequality would imply that z/o(cTi(i?f3 — q)) = 0{N~^). To prove ()2.16p we notice that by 
symmetry z/(o"i(i?i 3 — q)) = z/(a^(i?i 3 — g)), and we apply ()2.5|) which in this case implies 
that 

W{crN{Ri,3 - q)) - M^n{Ri,3 -q))\< "^'^((^LS - qY)'^' < ^, 



where in the last inequality we used ()2.4j) . Finally, 

1 1 

Uo{aN{Ri,3 - q)) = -qM^N) + j^M^NcrlfC^lf) + Uo^aNR^s)) = ^^o(o-Aror^(T^) = 0(A^^^). 

This finishes the proof of ()2.15p for A; = 1. It remains to prove the induction step. One can 
write 

N N N 

i=l i=l j=l 

Let us define z/j(-) in the same way we defined z^o(') only now the z-th coordinate plays the 
same role as the A^-th coordinate played for uq. Using Proposition 2.4.7 in J3] we get that 
for any Ti,T2 > 1 such that l/ri + l/r2 = l, 

N N 

i=i i=i 



5 (Zl ^J-^j) '''^O - (Zl ^J^j) ""^0 
i=i i=i 

<L/5V((5^t,aO^^^''=+'^) '"v{\R,^2-q\^^)'l^\ (2.18) 
1=1 

Let us take n = (2A; + 2)/(2A; + 1) and r2 = 2A; + 2. By flTi|) we can estimate 



.(i«,,-,r)-,.J^..;!i±l. ,2,19) 
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Next, we can write 

i=l i=l i=l 

If for some /5 and N 

V 



N 
i=l 

then for this parameters the induction step is not needed since this inequahty is pre- 
cisely what we are trying to prove. Thus, without foss of generahty, we can assume that 

^[{T.titi^iY^''^^^) >ik + which imphes that 



1=1 

Combining this with ^TH^ . ^TT^ and (fT^ we get 



Vk + T 



j = l j = l V 

Plugging this estimate into ()2.17|) we get 

N N N ^ N j^p2 ^ 

i=X i=X j=l i=l ^ 1=1 

TV AT N 

1=1 j = l i=l 

since (fT^ implies that < y/N. If 1/3"^ < 1/2, this implies that 

TV TV TV 



((E^'^O^'^O <2j2Uu,{a,{J2t,a,f^'). (2.21) 



i=l i=l j=l 

One can write, 

TV TV 



^^ (^i (E ^j'^jY''^^) = (^^ ( (E '^i^j) ^^^^ - (E 

since Vi[aii^^^^^t^(j^^^^^ = 0. Using the inequality 



n2A:+1 



|^2m _ ^2fc+i| < + l)\x- y\{x^' + y'') 
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we get 

N N 

<4(2fc + l)t,[z/,((J]t,a,)'') +z/,((^t,a,.)'')]. (2.22) 
First of all, by induction hypothesis ()2.15p we have 



since this is exactly ()2.15p for parameters iV — 1, /?_ = j3^Jl — 1/N, and since Ylij^i'^'] — ^■ 
Next, by Proposition 2.4.6 in jT3] we have 

AT N 

i^^{Q:tfa,Y')<L.{{Y,tfa,f)<iLk)\ 
where in the last inequality we again used ()2.15|) . Thus, ()2.2H) and ()2.22|) imply 

TV N 

V 

i=\ ' i=\ 

for L large enough. This completes the proof of the induction step and Theorem El 



iV iV 

^ 16(2fc+l)^t2^Lfc)^ <32(fc + l)(Lfc)*^ < + 



fc+i 



Remark. Theorem |21 and Lemmas |21 and El will be often used implicitly in the proof of 
Theorem ^ in the following way. For example, if we consider a sequence Si defined in (jl.5j) 
then by Holder's inequality (first with respect to (■) and then with respect to E) one can 
write 

v{{R.,^-q){R.^,-q)SlS'^ < z.((i?i,2-g)^)'/V((i?2,3-g)^)'/V(^f)^/V(^|2)^/' = 0(iV-i), 

where in the last equality we applied Theorem |21 and Lemma |21 Similarly, when we consider 
a function that is a product of the factors of the type Ri^u — q or Si, we will simply say that 
each factor Ri i/ — q contributes 0{N~^^'^) and each factor 5*^ contributes 0(1). 

The following result plays the central role in the proof of Theorem ^ We consider a 
function 



n 

\1l 



1=1 

where Si are defined in (jl.Sp and where qi are arbitrary natural numbers, and we consider 
the following quantity 

u{{Ri^l> - q){Rm,m' - q)(f)- 

We will show that this quantity essentially does not depend on the choice of pairs (/, /') 
and (m, m') or, more accurately, it depends only on their joint configuration. This type of 
quantities will appear when one considers the second derivative of v [cf) , after two applications 
of Lemma 1 or Lemma 4, and we will be able to cancel some of these terms up to the smaller 
order approximation. 
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Lemma 7 There exists (3o > such that for (3 < f3o the following holds. Consider four 
pairs of indices {1,1'), {m,m'), {p,p') and {r,r') such that none of them is equal to (l(j),2(j)) 
for j < n. Then, if either {1,1') 7^ {m,m') and {p,p') 7^ (r, r') or {1,1') = {m,m') and 
{p, p') = (r, r') then 

v{{Ri,v - q){Rm,m' - q)4>) - y{{Rp,p' - q){Rr,r' - q)(f) = 0(max \t,\N-^), (2.23) 
where &{■) depends on n, (3q, J2i<n ™^ ^• 

Proof. The proof is based on the following observation. Given (/, /') consider 

Ti^i, = N-\a^ - b) ■ (a'' -b),Ti = N~\(x^ -b)-b,T = N'^b ■ b - q, (2.24) 

where b = (a) = {{o'i))i<N- One can express Ri^i' — g as 

Ri,i' -q = Ti^v +Ti + Tv + T. (2.25) 

The joint behavior of these quantities ()2.24|1 was completely described in Sections 6 and 
7 of ^3]. Our main observation here is that under the restrictions on indices made in the 
statement of Lemma [7| the function will be "almost" independent of these quantities and 
all proofs in J3] can be carried out with some minor modifications. Let us consider the case 
when (/, /') 7^ {m, m') and {p,p') 7^ (r, r'). Using (j2.25|) we can write {Ri,i' — q){Rm,m' — <?) as 
the sum of terms of the following types: 

l,V-l-m,m.', -l-l,V-l-m, , J-l-l-m, -l-l-l- and I I . 

Similarly, we can decompose (-R^y — q){Rry — q)- The terms on the left hand side of (j2.23|) 
containing a factor TT will obviously cancel out. Thus, we only need to prove that any 
other term multiplied by will produce a quantity of order 0(max \ti\N~'^). Let us consider, 
for example, the term h'{Ti^i/Tm,m'4>)- To prove that h'{Ti^i'Tm,m'4>) = 0(max |ti|iV~-^) we will 
follow the proof of Proposition 2.6.5 in with some necessary adjustments. Let us consider 
indices z(l), ■j(2), z(3), i(4) that are not equal to any of the indices that appear in T/_//,Tm,m' 
or 0. Then we can write, 

u{Ti,i,T^^^4) = i^iN-^a' - a^(i)) ■ (a'' - a'^'y)N-\a^ - a'^'^) ■ {a^' - a^(^))0) 

N 

= AT-i ^z/((a5 - af )) ■ {a'j - af^){R^,m' - Rn^m - Rn.'m + i?^(3),i(4))0) • (2.26) 
i=i 

Let us consider one term in this sum, for example, 

^{{^^N ^ ^]v^^) ■ (^iV ~ (^^N^){Rm,m' " Rm,i{4) " Rm' ,i{3) + -Ri{3),j(4))0) • (2.27) 

If we define 

N-l N-1 n 

i=l i=l 1=1 
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then we can decompose ()2.27|) as 

+tNRi+tljR2 + 0{t% + tNN-'), (2.28) 
where -Ri is the sum of terms of the following type 

where (j)J = YYi=ii^r)'^^ / ^ -^2 is the sum of terms of the following type 

T^j,k _ f,l ^«(2)v 10) 2(i)w l(fc) 2(fc)^ 

^ iRm,m' ~ Rm,i{A) ~ Rm' ,i{3) + -^j(3),i(4) )'^j,fc) ' 

where 0", = UtiiSD'^ /(Sj S^). First of all, 

using Theorem 121 and Lemma El To bound R-[ we notice that vq{R]) = 0, and, moreover, 
i>q{R[) = 0{N~^), since by p.3|l each term in the derivative will have another factor R^^, —q. 
Therefore, using ()2.5|1 we get 

u{r{) = 0{N-'). 
The second term in ()2.28p will have order 0(N~^^'^) since 

and one can again apply ()2.5p . Thus the last two lines in ()2.28p will be of order 

To estimate the first term in ()2.28|1 we apply Proposition 2.6.3 in [15j which in this case 
implies 

K(4 - 4'^)(4 - ^T)iR-,n.' - ^-,(4) - R-'M3) + Rmm^^~) 

= L(3^u{{RiM - i?i,i(2) - Rl'A{l) + Ri{l),ii^)){R^,m' - R~m,i{i) ' R'm' ^ + ^*X3),i(4) 
+ 0(Ar-3/2). 

Now, using the similar decomposition as (j2.27|) . ()2.28p one can easily show that 

v[[Ri^li - i?,,i(2) - Rv^i(X) + Ri{l),i{^))iRm,m' " ^m,i(4) " ^m',i(3) + ^»X3),i(4) 

= ^{{Rl,l' — Rl,i{2) — Rl',i{l) + Ri{l),i{2)){Rm,m' " Rm,i{A) " Rm' ,i{3) + -Rj(3),i(4) )0) 
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Thus, combining all the estimates the term ()2.27|) becomes 

All other terms on the right-hand side of ()2.26|) can be written in exactly the same way, by 
using the cavity method in the corresponding coordinate and, thus, (j2.2()|l becomes 

TV 

= Lp''v{Ti^i>Tm,m'(p) + 0(max \U\N-^). 

For small enough /3, e.g. < 1/2 this implies that i^{Ti^i'Tm,m'4>) = 0(max |tj|A^~^). To 
prove ()2.2Hp in the case when (/,/') 7^ {m,m') and {p,p') 7^ {r,r'), it remains to estimate 
all other terms produces by decomposition ()2.25|) and this is done by following the proofs of 
corresponding results in the Section 2.6 of 15 . 

The case when (/,/') = (m, m') and {p,p') = {r,r') is slightly different. The decomposi- 
tion of {Ri,i' — using ()2.25|1 will produce new terms viTfiicf)) and viTfcf)), which are not 
small but up to the terms of order 0(max \ti\N^^) will be equal to the corresponding terms 
produces by the decomposition of (-Rpy — qY- To see this, once again, one should follow the 
proofs of the corresponding results in the Section 2.6 of J3] with minor changes. 

p 



3 Proof of Theorem [T] 

Theorem ^ is obvious if at least one ki is odd since in this case the left hand side of ()1.6|) 
will be equal to 0. We will assume that all ki are even and, moreover, at least one of them is 
greater than 2, say ki > 4. Since a{l) = {I — l)a{l — 2), in order to prove (|1.6|) it is, obviously, 
enough to prove 

n n 

|E(n(^0'0 - ih - l)E((^o)^(^i)'=-^n(^')'')l = 0(^^ax|t.|). (3.1) 
1=1 1=2 

We will try to analyze and compare the terms on the left hand side. Let us write 

n N n 

n(^')''=E^^^'(^i)'^-'n(^')'' (3-2) 
1=1 1=1 1=2 

and 

n N n 

{S,f{S,f^-^\[{Sit = Y,Ua^{S,){S,f^-'\[{Sit. (3.3) 

1=2 i=l 1=2 
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From now on we will carefully analyze terms in ()3.2|) in several steps and at each step we 
will notice that one of two things happens: 

(a) The term produced at the same step of our analysis carried out for ()3.3|1 is exactly 
the same up to a constant ki — 1; 

(b) The term is "small" meaning that after combining all the steps one would get 
something of order 0(max \ ti\). 

Obviously these observations will imply ()3.H) . 

Let us look at one term in ()3.2p and ()3.3p . for example, 

n n 
1=2 1=2 

If we define Sf by the equation 



Si — Si + tivcrjY, 



then, 



1=2 1=2 

n n 

= ^NiS^t-' X{{S;t + (^1 - l)tN{cy],)\S^f^-' \[{Si 

1=2 1=2 

n 

J2 kaWAs^r^-'isn''-' n (^7)'^' + 

1=2 

= l + tNll + tNlll + 0{t%). 



and 



1=2 1=2 

n n 

= AiSoKSr)'^-' u^sD'^ + tNi^ns^r^-' HiS^ 



'I 

1=2 



+t^[j2kM{s^)''-'{Si)'^-' n (s-p 

1=2 

n 

= iv + t^v + t^vi + 0(4). 

First of all, z/o(III) = z^o(VI) = and, therefore, applying ()2.5p 

t^vi^W) = 0{tNN-^/'^) and z/(VI) = 0(t7vA^"^/^). 
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Next, again using ()2.5|) 

t^z/(ii) = t^z/o(n) + t^0(iv-V2) 

n 
1=2 

and 

t^Zy(V) = t^Z/o(V)+tjv0(iV-'/') 

n 

Thus the contribution of the terms II and V in (jH.lj) will cancel out - the first appearance of 
case (a) mentioned above. 

The terms of order 0(t^ + tArA^~^/^) when plugged back into ()3.2|) and ()3.3|) will produce 

N 

^ti0(t2 + t.Ar-i/2) = 0(max|ti| + = 0(max|ti|). (3.5) 

1=1 *~ *~ 

Here we, of course, assume that similar analysis is carried out for the i-th term in ()3.2|1 and 
()3.3|1 with the only difference that the ith coordinate plays the special role in the definition 

of Z/Q. 

We now proceed to analyze the terms I and IV. If we define Sj" by the equation 
then, 

n n 

1=2 1=2 
+'tN-l{ki — l)Ro + tN-lRl + t^_i(-R21 + R22 + R23) + ^AT-i-Rs + 0(^Ar_i)- 

where 

n 

1=2 

n 

R, = Y.kaWN-iiSTr-\srf^-' n isrr\ 

1=2 

^ ^ 1=1 

R22 = E ^(^^)^ 

1=2 ^ ^ 
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and where R23 is the sum of terms of the following type 

n 

i=i 

for some (not important here) powers qi, and where is the sum of terms of the following 
type 

n 

Similarly, 

n n 

IV = cT%{s^){s^r-' l[(^r)'' = cr%{s=){STr-' Hisrr^ 

1=2 1=2 
+tN~lRo + tN-lRl + tAf_i(-R21 + R22 + -R23) + ^AT-i-Rs + 0(iAr_i)- 

where 

n 

1=2 

n 

^ ^ (=2 

i=2 ^ ^ jyo,i,i 
and where ^23 is the sum of terms of the following type 

n 
j=0 

for some (not important here) powers qi, and where ^3 is the sum of terms of the following 
type 

n 

i=o 

(Step 1). First of all since z/o(i?3) = 0, we have ^{R^) = 0{N~^/^) and t^_iZ/(i?3) = 
0{t%_iN~^/^). Next let us show that z/(i?23) = 0(A^"^). Indeed, one need to note that 
i^oo(-R23) = 0, and using Lemma El z^oo(-^23) = 0(A^~^) since each term produced by (j2.9j) 
will have a factor {a^]y_i)oo = 0, each term produced by (j2.1Uj) will have a factor ((x^)oo = 0, 
and each term produced by ()2.1H) has factor N~^. Thus it remains to use ()2.13|) to show 
that z/(i?23) = 0(iV"^). 
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Similarly, one can show that i/(i?3) = 0(iV-i/2) and z/(i?23) = 0{N-^). 

(Step 2). Let us show now that z/(i?i) = 0(A^^^/^). Let us consider one individual term 

Obviously, z/oo(-Ri«) = 0. To show that u^q^Rh) = 0, let us first note that the terms produced 
by ()2.9p will contain a factor (cr^_i)oo = 0, the terms produced by ()2.10p will contain a 
factor {(Tlf)oo = 0, and the terms produced by (j2.11|) will contain a factor ((5'f )'^^^^)oo = 0, 
since fci — 1 is odd and is symmetric. For the second derivative we will have different 
types of terms produced by a combination of ()2.9|) . ()2.10|) and ()2.1H) . The terms produced 
by using ()2.11|) twice will have order 0{N~'^); the terms produced by using ()2.11|) and either 
()2.10|1 or ()2.9|) will have order 0(A^~^/^), since the factor Rf^, — q will produce iV~^/^; the 
terms produced by ()2.9j) and ()2.9|1 . or by ()2.1()j) and ()2.1()j) will be equal to since they will 
contain factors ((Tjv-i)oo = and (a']^)oo = correspondingly. Finally, let us consider the 
terms produced by ()2.9|) and ()2.10p . e.g. 

It will obviously be equal to unless m,p E {1(1), 2(1)} and m',p' G {l(/),2(/)} since, 
otherwise, there will be a factor {(fjf)oo = or (o'^)oo = 0. All non zero terms will cancel 
due to the following observation. Consider, for example, the term 

(T^ l-f<l(l),l(0 - ^J^JV-l^Af-ll-f^2(l),2(0 ~ ^Jj - '^OoiCTAT - (^N )^ 

which corresponds to m = 1(1), m' = l{l),p = 2(1) and p' = 2(/). There will also be a similar 
term that corresponds to m = 2(1), m' = l(/),p = 1(1) and p' = 2(Z) (indices m and p are 
changed) 

m[rCll<^N '^N l-n^2(l),l(0 ~ ^KAr-l'^Af-ll^l(l),2(0 ^ 9jj - ^Ool^O'iV <^ N '^N - N 

M^T-^Ti^TA'li)M(RmMi)-'i)(Rm^^^^^ 

These two terms will cancel since the product of the first two factors is unchanged and, 
making the change of variables 1(1) — > 2(1), 2(1) — > 1(1) in the last factor we get (note that 
Tf ^ -Tf) 

MiR2ii),m - Q)iRmm - q){TTf^-\Trt-' H (^r)'O 
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Using TU^ we finally get that = 0(A^-3/2). 

Similarly, one can show that v{Ri) = 0{N^^^^). 
(Step 3). Next, we will show that 

iy{R2i) - {h - 1HR21) = 0{N-') (3.6) 

and 

i^{R22) - {h - IHR22) = 0(iV-i). (3.7) 

We will prove only ()3.fi|l since ()3.7|) is proved similarly. Since i^oo(-R2i) = t'oo(-R2i) = it is 
enough to prove that 

n 

1=2 

= (fci-i)(^'2'^)^oo(4K-i)'(5o=)(5r)'=^-^n(5r)'0 + 0(^"')- (3-8) 
^ ^ 1=2 

On both sides the terms produced by ()2.10|) will be equal to 0, the terms produced by ()2.1ip 
will be of order 0(iV~^), thus, it suffices to compare the terms produced by ()2.9|) . For the 
left hand side the terms produced by ()2.9|1 will be of the type 

n 

1=2 

and will be equal to unless m G {1(1), 2(1)} and m' ^ {1(1), 2(1)}. For a fixed m' consider 
the sum of two terms that correspond to m = 1(1) and m = 2(1), i.e. 

n 

1=2 

n 

+^oo((4'^4'^<' - <')(4-i)'(^2ii),„.' - ^mt-' WiSTt) 

1=2 

n 

= Mi^N -4'^4'''^N))m{{^l,-ir)m{{RTw^^^ 

1=2 

n 

= c^oo((i?r(i),^' -^2ii),„^')(^r)'^-'n(^r)'0- 

1=2 

For m' G (1(2), 2(2), ... , l{n), 2{n)} this term will have a factor and for m' = 2n + 1 
it will have a factor — /3^(2n). Similarly, the derivative on the right hand side of ()3.8p will 
consist of the terms of type 

n 

cm{{Ri(o),m' - ^2(o),m')('S'cr)('S'r)^'~^n('S'r)''0- 

1=2 
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For m' G {1(1), 2(1), . . . , l(^), 2(n)} this term will have a factor and for m' = 2n + 3 it 
will have a factor —j3'^{2n + 2). We will show next that for any m' and m", 

n 

1=2 

n 

= {h - s)uoo{{RT^o),m" - Rm,m")is^)iSTr'-' U^sn'') + 0(iv-i). (3.9) 

1=2 

This implies, for example, that all terms in the derivatives are "almost" independent of the 
index m'. This will also imply (j3.8|) since, given arbitrary fixed m', the left hand side of (j3.8j) 
will be equal to 

(7 _ 1 \ " 

c/32((2n-2)-(2n))z.oo((i?r(o),™'-^r(o),..')(5o=)(^r)'^~'n(^r)'O+0(^"') 
^ 1=2 

and the right hand side of ()3.8|) will be equal to 

(h — 9\ " 
' c/52((2n)-(2n+2))z.oo((i?r(o),™'-^2lo),„.')(^o=)(^r)'^-'n(^r)'^O+0(^"')' 
^ 1=2 

which is the same up to the terms of order 0(A^~^). For simplicity of notations, instead of 
proving ()3.9|) we will prove 

n 
1=2 

n 

= ih - 3)u{{R^o),m" - R2io),m")iSo){Si)'''-'l[{Si)''') + 0(7^1). (3.10) 

1=2 

Let us write the left hand side as 

n N 

z/((i?i(i),„, -i?2(i),™')('^i)'^"'n('^')'o =^~'E^(^^)' 

1=2 i=l 

where 

n n 

u^ = (^^'^'^ -^f vr'(^i)'^-'n(^')'' =^'^r'(^i)'^-'n(^')''- 

1=2 1=2 

and consider one term in this sum, for example, v{Um). Using (j2.5p . one can write 

v{Un) = vo{Un) + v'o{Un) + 0(iV-i) 

and 
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since each term in the derivative already contains a factor ^ — q. Thus, 

y{UN) = MUn) + y'{UN) + 0(iV-^). 

Similarly, 

p{U,)=Ui{U,) + p\Ui) + &{N~^), 

where Vi is defined the same way as z/q only now ith coordinated plays the same role as A^th 
coordinate plays for z/o(= uj^). Therefore, 



1=2 1=1 

n N 



1=2 i=l 

again using ()2.ia|l and ()2.12|1 and writing -Ri(i),m' - -R2(i),m' = (-Ri(i),m' - - (-R2(i),m' - <?)• 
Similarly one can write, 

n N 
Z=2 j=l 

where 

n 

V, = {af'^ - af^)af{So){S^)'^~'l[{S,)''. 

1=2 

If we can finally show that 

MUi) = {h-3MVi} + 0{t^,), 
this will prove ()3.1U|) and ()3.8|) . For example, if we consider i'o^Un), 

n n 

Z=2 Z=2 
n 

1=2 

n 



Z=2 
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since all other terms are equal to 0. Similarly, one can easily see that 

n 

^o(v^iv) = t^^o((ajv)^)^oK>o((5r)'=^-'n(^r)'') + 0(4)- 

1=2 

This finishes the proof of (j3.8|) . 

The comparison of R22 and R22 can be carried out exactly the same way. 
(Step 4). The last thing we need to prove is that 

p{Ro) - u{Ro) = 0(max \ti\N-^) (3.11) 

i 

or, in other words, 

n n 

1=2 1=2 

First of all, clearly, z/oo(-Ro) = ^ooiRo) = 0. Next we will show that 

^00(^0)- ^00(^0) = 0. (3.12) 

The terms produced by ()2.9|) and ()2.10|) will be equal to 0, because they will contain either 
the factor (o"Ar)oo = ((ctjv)oo = ) or the factor {d'j^_i)oo = ((o'^_i)oo = 0). The terms of 
u'qqIRq) produced by ()2.1H1 will be of the type 

n 

iV-Voo(cr^cr>]^>oo(^^-icr]^-iO^]^li)^oo((5r)'^"'n(^r)'0 

1=2 

and they will be different from only if m G {1(1), 2(1)} and m' ^ {1(1), 2(2)}. For m G 
{1(1), 2(1)} and m' G {1(2), 2(2), . . . , 1(?t.), 2(n)} these terms will have a factor and for 
m G {1(1), 2(1)} and m' = 2n + 1 these terms will have a factor — (2n)/9^. Similarly, the 
terms of z/qq(^o) produced by ()2.1H) will be of the type 

iV-Voo(a^<a^)^oo(a°,_,<_,4-Jz.oo((^r)'^-'n(^r)'0 

1=2 

and they will be different from only if p G {1(0), 2(0)} and p' ^ {1(0), 2(0)}. For p G 
{1(0), 2(0)} and p' G {1(1), 2(1), . . . , l(n), 2(n)} these terms will have a factor and for 
p G {1(0), 2(0)} and p' = 2n + 3 these terms will have a factor —{2n + 2)/5^. For m = 1(1) 
(or m = 2(1)) and a corresponding p = 1(0) (or p = 2(0)) the non zero terms above will be 
equal, so when we add up the factors over m' and p' we get 

P^{{2n -2)-2n- {2n) + {2n + 2)) = 0. 

This shows that Uqq^Rq) — u'^q^Rq) = 0. 
Next we will show that 

^00(^0) - ^^oo(^o) = 0(max \U\N-'). (3.13) 
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The second derivative will have different types of terms produced by an iterated application 
of dTH), (l^rrni) and (jTTT| . The terms produced by using ^^JT^ twice will have order 0{N-'^); 
the terms produced by using ()2.11|1 and either ()2.10j) or ()2.9|1 will have order 0(A^~^/^), since 
the factor R'fi, — q will contribute A^~^/^ 

via the application of ()2.12|1 : the terms produced by ()2.9|1 and ()2.9|1 . or by ()2.1()|1 and 
()2.10|) will be equal to since they will contain a factor (o"jy„i)oo = or (crjy)oo = corre- 
spondingly. Finally, let us consider the terms produced by ()2.9|) and ()2.10j) . For Uqq^Rq) they 
will be of the type 

n 
1=2 

and will be equal to unless m,p e (1(1), 2(1)} and m',p' ^ {1(1), 2(1)}. For i^qo{Ro) the 
terms will be of the type 

n 

= z/oo(4cr-Oz^oo(^ri<_i<_i)^oo((^= - q){R;,,> - q){STf^-' H^^D'O 

1=2 

and will be equal to unless m,p E {1(0), 2(0)} and m',p' ^ {1(0), 2(0)}. Now, to show 
()3.13|) one only needs to apply ()2.23p and notice that for each case in Lemma [7| (i.e. for 
(m, m') = {p,p') or {m,m') ^ {p,p')) there will be equal number of positive and negative 
terms that will cancel each other out up to the terms of order 0(maxj \ti\N~^). The count 
of this terms is done similarly to what we did in the proof of ()3.12j) and we omit it. Finally, 
(jTT^ and (prn^ imply ^TT^ via the application of ^TT^ . 
Now we can combine Steps 1 through 4 to get that 

n n 
1=2 1=2 

+0(4-1 + t%^iN-^/^ + tl^^N-'^ + tN^i max \ti\N-^). 

i 

We notice that the first two terms on the right hand side 

n n 
1=2 1=2 

are absolutely similar to z/(I) — {ki — l)z/(IV), with the only difference that 5"^" is now 5';'". 
Thus we can proceed by induction to show that 

N-l 

- {h - l)'^(IV) = J2 + ^i^"^^^ + ^i^"^ + tj max \ti\N-^). 
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We can now add up the contributions of the terms I and IV (and terms similar to ()3.4|) 
arising from ()3.2p and ()3.3p ) in the left hand side of ()3.1|) to get 

^ + t^^N-'/^ + t^AT-i ^ \ti\N^^) = 0(max \ti\), 

which is a simple calculus exercise, provided that J^iKN^l ~ ^- This, together with ()3.5|) . 
completes the proof of ()3.1|) and the proof of Theorem^ 



□ 
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